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Preface 

Chance-constrained,  programming  can  best  be  described  as 
an  attempt  to  optimally  allocate  resources  in  situations 
where  the  decision  maker  is  faced  with  risk  and  uncertainty. 

It  can  be  a  valuable  tool  for  the  decision  maker  since  it 
gives  him  direct  control  over  some  of  this  risk.  In  writing 
this  thesis,  I  have  attempted  to  give  the  analyst  a  review  of 
the  fundamental  theory  of  chance-constrained  programming. 

The  thesis,  however,  should  not  be  considered  a  literature 
search  or  a  review  of  all  the  developments  and  applications 
of  this  theory,  but  it  should  give  the  analyst  a  thorough 
introduction  to  the  subject,  one  which  can  be  used  to  solve 
most  problems  that  an  analyst  might  encounter  in  this  area. 

However,  this  thesis  does  introduce  a  new  distribution 
free  approach  to  chance-constrained  programming  which  was 
developed  by  R.  A.  Agnew.  I  would  like  to  express  my  personal 
appreciation  to  Dr.  Agnew  for  sharing  these  developments  with 
me  and  also  for  the  aid  he  has  given  me  in  the  preparation 
of  this  paper.  However,  I  want  to  point  out  that  any  errors 
which  might  appear  in  this  thesis  are  solely  the  responsi¬ 
bility  of  the  author. 

Finally,  I  would  like  to  express  my  sincerest  appre¬ 
ciation  to  ray  wife,  Dianne,  for  enduring  the  neglect  that 
resulted  from  this  effort. 
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Abstract 

This  thesis  is  concerned,  with  the  development  of 
certainty  or  deterministic  equivalent  nonlinear  programming 
models  from  chance -cons trained  programming  models.  It 
contains  a  review  of  some  of  the  historical  developments  in 
this  area  which  were  made  by  Charnes  and  Cooper,  Kataoka, 
Miller  and  Wagner,  Hillier,  and  Sengupta.  The  thesis  intro¬ 
duces  a  new,  distribution  free  approach  to  chance-constrained 
programming  which  can  be  used  with  both  single  and  joint 
chance  constraints.  Finally,  the  distribution  free  chance- 
constrained  model  is  applied  to  the  economic  problem  of  input- 
output  analysis. 
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Chapter  I 
Introduction 

I 

Background  Information 

Throughout  history,  mankind  has  been  concerned  with  the 
problem  of  optimal  allocation  of  limited  resources  among1 
competing  activities.  The  problem  has  been  widespread.  Gen-  1 
erals  have  asked  the  question  of  whether  their  chances  of 
victory  would  be  greater  if  initially  committed,  a 

division  to  combat  or  if  they  held  that  division  in  reserve 
to  be  utilized  at  a  later  stage  in  the  battle.  Farmers1  have 
wondered  whether  their  return  would  be  greater  if  they  planted 
only  corn,  only  wheat,  or  some  mix  of  the  two  crops.  Like¬ 
wise,  entrepreneurs  have  continually'  searched  for  more  effi-  . 
cient  ways  of  production  in  order  that  they  might  increase' 
profits.  To  aid  man  in  his  search  for  answers  to  these 
questions,  the  sciences  of  economics,  operations  research,  and 

i 

systems  analysis  were  developed;  and  it  is  from  these  sciences, 
that  man  has  gotten  the  very  valuable  tool  of  linear  pro¬ 
gramming. 

Linear  programming  was  initially  developed  by  George  B. 

f 

Dantzig  in  19^7  as  a  technique  for  planning  the  diversified 
activities  of  the  U.  S.  Air  Force,  In  any  operating  period 
the  Air  Force  has  many  activities  such  as  logistics,  training, 
maintenance,  and  operations  which  have  to  be  coordinated  in 
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order  to  achieve  specif io  goals.'  Thus  linear  programming 
addresses  the  problem  of  setting  optimal  levels  for  these 
activities.  Mathematically.,  the  linear  programming  model  is 
normally  formulated  in  the  following  manner: 
maximize  E^  ^  ^  CjXj 

subject  to  Ej  ^  ^  aljxj  “  bi»  i  ~  1»  2,  . m 
i  xj  -  0;  J  -  1,  2,  n, 

where  is  the  j-th  decision  variable,  i.e.  the  level  that 
the  decision  maker  chooses  to  set  for  the  j-th  input,  product, 
or  the  j-th  component  of  whatever  the  decision  maker  controls, 
and  the  e.,  a,,,  and  b.  are  known  constants.  Such  a  model, 
as  formulated,  might  carry  the  economic  interpretation  that 
a  firm  which  utilizes  m  separate  production  processes  in 
order  t 6  produce  n  difrerent  products  is  attempting  to  maximize 
total  receipts  from  the  sale  of  thes'b  products  subject  to  the 
.constraint  that  each  production  process  is  not  operating 
above  riapacity.  Here  the  decision  maker  is  attempting  to 
set  optimal  levels  of  product  output.  Dantzig  developed  the 

Simplex  algorithm  to  solve  this  linear  programming  problem; 

] 

and  since  that  time  the  model  has  satisfactorily  been  applied 
to  not  only  production  problems,  but  to  problems  in  the  areas 

i 

of  transportation,  agriculture,  and  dietetics,'  just  to  name 

a  few. 

Although  the  linear  programming  model  has  been  concep- 

.  I 

tually  useful  for  planning  in  many  areas,  it  has  a  major 
drawback.  The  coefficients  o^,  and  b^  are  assumed  to  be 
known  constants,  whereas,  in  reality,  they  may  neither  be 
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known  nor  constants.  Since  the  model  i3  utilized  to  select 
some  future  course  of  action,  the  estimates  on  these  coef¬ 
ficients  would  be  based  on  pjme  prediction  of  future  conditions. 
Information  used  in  this  estimation  may  not  be  sufficient  to 
accurately  predict  the  future  values  of  the  coefficients. 
Furthermore,  the  values  of  the  coefficients  could  be  greatly 
influenced  by  random  events  which  are  impossible  to  predict. 

This  leads  to  the  problem  where  some  or  all  of  the  coeffi¬ 
cients  are  actually  random  variables.  One  approach  of 
handling  this  problem  would  be  to  obtain  estimates  of  the 
means  of  the  random  coefficients  and  to  use  these  estimates 
in  the  linear  programming  model.  Certainly  such  an  approach 
will  give  the  decision  maker  some  insight  into  his  problem, 
but  it  completely  ignores  the  random  nature  of  the  problem 
and  suppresses  the  uncertainty  that  the  decision  maker  faces. 
However,  under  this  approach  a  good  analyst  would  perform 
sensitivity  analysis  on  the  model;  and  this  would  give  the 
decision  maker  some  insight  into  the  uncertainty  he  faces. 

But  it  can  be  safely  assumed  that  as  the  number  of  random 
elements  increases,  the  sensitivity  of  the  solution  to  the 
model  also  increases,  thus  decreasing  the  value  of  the  solu¬ 
tion  to  the  decision  maker.  However,  there  are  other  ap¬ 
proaches  that  analysts  can  take  when  attempting  to  apply  the 
linear  programming  model  to  situations  possessing  a  high  level 
of  uncertainty. 

Several  approaches  to  the  problem  of  mathematical  pro¬ 
gramming  under  uncertainty  have  been  developed.  One  approach, 
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developed  by  G.  Tintner,  Is  called  "stochastic  linear  pro¬ 
gramming"  and  deals  with  the  probability  distribution  of 
max  Ej  a  ^  cjXj.  A  second  approach,  developed  by  G.  Dantzig, 
is  called  "linear  programming  under  uncertainty M.  This 
approach  has  successfully  been  applied  to  multi-period  prob¬ 
lems  where  a  decision  is  made  each  period  after  the  values 
of  some  of  the  random  elements  become  known.  A  third  approach 
was  developed  by  Charnes  and  Cooper  and  is  called  Chance- 
Constrained  Programming.  It  has  the  mathematical  formulation 
max  f{x1P  . ..,  xn) 

subject  to  p[Z^  i  aijxj  *  1  -  c^;  I  ■  1,  2,  . .  ,m 

Xj  ^  O'  J  =  1»  2» 

where  again  x^  is  the  j-th  decision  variable,  and  the 
and  b^  may  be  random  variables.  In  this  case  the  objective 
function,  f(x^,  xn) ,  is  an  attempt  to  quantify  the  de¬ 

cision  maker's  goal  in  terms  of  the  decision  variables.  Also, 
P[Ej  ”  1  aijxj  -  2r  1  -  ai  is  interpreted  to  mean  that  the 
probability  that  the  i-th  constraint  is  violated  is  less  than 
c^,  an  appropriately  chosen  number  between  zero  and  one.  If 
f(xlf  ...,  xn)  is  a  linear  function,  one  can  see  that  the 
formulation  of  the  chance-constrained  model  closely  resembles 
the  linear  programming  model,  but  it  changes  the  i-th  con¬ 
straint  from  a  linear  inequality  into  a  probability  statement, 
thus  recognizing  the  uncertainty  associated  with  the  problem. 

There  is  an  important  distinction  between  the  chance- 
constrained  model  and  most  other  constrained  optimization 
problems  since  the  violation  of  the  constraints  is  permissible 
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in  the  chance-constrained  approach.  One  may  question  the 
merit  of  allowing  a  constraint  to  be  violated,  but  it  can  be 
demonstrated  that  this  is  a  valuable  practice  when  dealing 
with  problems  which  contain  elements  subject  to  random 
variation.  To  illustrate  this  point,  suppose  one  is  pro¬ 
ducing  a  product  with  the  constraint  that  the  random  demand 
for  that  product  muGt  always  be  met,  i.e.,  demand  is  met  with 
probability  one,  Eut  such  a  policy  says  that  the  probability 
that  production  exceeds  demand  is  one  or  very  close  to  one, 
and  if  the  variance  of  this  random  demand  is  large,  over 
production  may  also  get  large  causing  storage  costs  to  rlss, 
thus  cutting  into  profits.  The  chance-constrained  pro¬ 
gramming  approach  to  this  problem  would  permit  the  decision 
maker  to  specify  the  level  of  risk  of  not  meeting  demand  that 
he  is  willing  to  face.  This  is  done- by  choosing  an  appro¬ 
priate  a^.  It  is  in  this  light  that  one  sees  the  value  of 
using  the  chance-constrained  programming  model,  since  it 
forces  the  decision  maker  to  recognize  the  risk  he  faces  and 
allows  him  to  choose  the  level  of  risk  he  feels  appropriate 
for  the  problem. 

Consider  again  the  i-th  chance-constraint  which  is 
written  as 

P^j  =  i  aijxj  “  bi^  -  1  -  V 
Since  the  and  may  be  random  variables  (it  is  assumed 

that  there  is  at  least  one  random  variable  in  each  chance- 

constraint),  it  is  clear  that  the  chance-constraint  cannot 

be  directly  utilized  in  solving  the  chance-constrained 
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programming  model.  It  is  then  necessary  that  one  transform 
the  chance -constraint  into  a  deterministic  equivalent 
constraint  which  is  free  of  any  random  variables  before  the 
model  can  be  solved.  Most  of  the  literature  written  in  this 
area  has  addre3;  ed  this  problem,  but  in  many  cases,  the 
authors  made  assumptions  about  the  probability  distributions 
of  the  random  variables  a^j  and  b^.  These  assumptions  have 
limited  the  applicability  of  their  deterministic  equivalent 
model. 

The  Problem 

J.  K,  Sengupta  and  S.  M.  Sinha  have  utilized  the 
Chebyshev  inequality  in  chance-constrained  programming.  The 
inequality  has  a  particularly  useful  characteristic  in  that 
it  holds  regardless  of  the  probability  distribution  of  the 
random  variable  being  measured.  The  purpose  of  this  paper 
is  to  utilize  the  Chebyshev  inequality  to  develop  deter¬ 
ministic  equivalent  constraints  for  single  chance-constraints 
and  joint  chance-constraints,  a  concept  developed  by  Miller 
and  Wagner.  The  model  developed  will  be  general  in  that  it 
will  allow  any  of  the  coefficients  to  be  random  variables 
with  unknown  probability  distributions.  The  model  will  then 
be  applied  to  the  economic  problem  of  input -output  analysis 
to  demonstrate  its  usefulness  to  the  decision  maker. 

Overview 

Chapter  II  of  this  paper  will  Illustrate  some  of  the 
approaches  t-hat  other  authors  have  taken  in  solving  the 
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chance-constrained  programming  model.  The  assumption  will 
initially  be  made  that  the  probability  distributions  of  the 
random  variables  Involved  are  known.  Then  deterministic 
equivalent  constraints  will  be  developed.  This  assumption 
will  then  be  relaxed.  Also,  Miller  and  Wagner's  concept  of 
a  joint  chance-constraint  will  be  reviewed.  Finally,  J.  K. 
Sengupta's  approach  to  chance -constrained  programming  which 
utilizes  the  Chebyshev  inequality  will  be  reviewed. 

Chapter  III  will  extend  the  use  of  the  Chebyshev 
inequality  to  give  deterministic  equivalent  constraints 
which  can  be  used  to  solve  the  most  general  case  of  the 
chance -cons trained  programming  model  which  has  both  single 
and  Joint  chance-constraints. 

Chapter  IV  will  then  apply  the  results  of  chapter  III 
to  the  economic  problem  of  input -output  analysis.  The 
Input-output  analysis  model  will  also  be  modified  to  show 
how  it  might  be  of  use  to  the  Air  Force  and  other  Department 
of  Defense  planners. 
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Chapter  II 

Historical  Developments 

The  chance-constrained,  programming  model  is  normally 
formulated  as 

max  . ..,  xn) 

subject  to  P[IvJ  =  ^  aijxj  -  2  1  -  i  *  1,  2,  m 

Xj  >  0  j  a  1|  2|  • i • i  nf  (1) 

where  the  are  the  non-stochastic  decision  variables,  the 

a^j  and  bi  may  be  random  variables,  and  the  is  an  appro¬ 
priately  chosen  number  which  lies  between  0  and  1.  The  i-th 
probabilistic  constraint  allows  that  constraint  to  be  vio¬ 
lated  with  probability  c^;  hence  represents  the  allowable 
risk  which  the  decision  maker  chooses  to  face.  This  formu¬ 
lation  additionally  requires  that  the  n  decision  variables 
all  be  non-negativ 2,  which  is  generally  the  case  for  most 
economic  problems.  However,  one  could  easily  restrict  the 
feasible  region  of  choice  for  the  decision  variables  by 
including  other  non-probabilistic  constraints  in  the  form  of 
linear  inequalities,  where  constants  and  the  coefficients  of 
the  decision  variables  are  non-stochastic. 

As  formulated,  the  chance -cons trained  programming  model 
cannot  be  directly  solved,  but  each  of  the  probabilistic 
constraints  must  be  reduced  to  certainty  equivalent  or 
deterministic  equivalent  constraints.  This  is  accomplished 
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by  using  the  means  and.  variances  of  the  random  variables 
given  in  the  chance-constraint  and  developing  certainty 
equivalent  constraints  which  are  usually  in  the  form  of  non¬ 
linear  Inequalities.  Before  investigating  some  of  the 
approaches  taken  by  various  authors  in  this  area,  a  few 
words  should  be  said  about  an  appropriate  choice  for  the 
objective  function,  f(x1,  xn). 

The  Objective  Function 

In  choosing  an  objective  function  to  be  used  in  the 
chance-constrained  programming  model,  an  analyst  should 
attempt  to  quantify  the  decision  maker’s  major  objective. 

This  usually  gives  some  mathematical  function  in  terms  of 
the  decision  variables,  x^,  xn»  It  is  seen  in  the  lin¬ 

ear  programming  model  that  the  objective  function  is  given 
by 

and  this  objective  function  could  carry  the  interpretation 
that  the  firm  is  attempting  to  maximize  receipts  from  the 
sale  of  goods  produced.  Here  c^  represents  the  market  price 
for  product  j.  This  certainly  appears  to  be  a  logical 
j  choice  for  a  firm’s  major  objective.  Clearly,  this  objective 

function  can  be  utilized  in  the  chance-constrained  pro- 
gramming  model.  However,  since  the  firm  is  operating  in  an 
environment  of  uncertainty,  it  appears  quite  likely  that 
some  of  this  uncertainty  will  be  encountered  in  the  market; 
hence  each  price,  c^,  could  very  possibly  be  a  random 


9 


GSA/SM/72-15 


variable.  It  would  be  ambiguous  to  deal  with  max  E1?  ,  c.x. 

J  *  1  J  J 

when  the  Cj  are  random  variables.  As  is  the  case  with  the 
probabilistic  constraint,  one  must  develop  a  certainty 
equivalent  expression  for  receipts  In  order  to  use  maximum 
receipts  as  the  objective  function.  Since  receipts  are  nor¬ 
mally  a  linear  function  of  the  decision  variables,  and 
programming  algorithms  using  a  linear  objective  function 
deal  primarily  with  a  relative  weighting  of  the  decision 
variables,  it  seems  logical  to  utilize  the  expected  value  of 
receipts  as  the  appropriate  objective  function.  Since  the 
decision  variables  are  assumed  to  be  non-stochastic,  this  i3 
given  by 

E(2j  =  1  CJXJ)  *  2 j  =  1  E(cj)xj» 
where  E(Cj)  is  the  expected  market  price  for  product  J.  The 

chance-constrained  programming  model- which  uses  this  ob¬ 
jective  function  is  referred  to  as  the  HE  Model",  a  term 
given  by  Charnes  and  Cooper,  the  developers  of  the  model. 

Use  of  the  E  Model  will  be  satisfactory  if  the  decision 
maker  or  the  firm  has  a  linear  utility  for  wealth,  but,  in 
reality,  most  individuals  have  a  diminishing  marginal  utility. 
The  logarithmic  utility  function  is  a  good  example  of  this. 
Therefore,  if  the  decision  maker  does  not  have  a  linear 
utility  for  wealth,  the  analyst  must  use  some  function  which 
represents  the  expected  utility  of  profits  as  an  objective 
function.  Since  profit  is  a  random  variable  whose  distri¬ 
bution  may  be  known  or  unknown,  it  might  be  difficult  to 
obtain  an  expression  for  the  expected  utility  of  profits. 
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However,  due  to  the  arbitrary  nature  of  moat  utility  func¬ 
tions,  it  would  be  permissible  to  use  a  tractible  1(  wer 
bound  as  the  objective  function  in  place  of  the  expected 
utility  function.  R.  A.  Agnew,  [2]  and  [3],  has  developed 
such  bounds,  and  they  depend  only  on  the  mean  and  variance 
of  random  profits.  The  chance-constrained  programming  model 
which  uses  a  bound  for  the  expected  utility  of  wealth  can 
readily  be  applied  to  the  problem  of  portfolio  selection 
[1],  [25],  and  [26]. 

Suppose  the  deolsion  maker  is  more  concerned  with 
minimizing  the  random  fluctuations  of  receipts,  as  opposed 
to  maximizing  expected  receipts.  In  this  case,  the  analyst 
would  use  min  Var  a  c^x^)  as  the  objective  function. 
Fortunately,  this  variance  function  is  a  positive  serai- 
definite  quadratic  form  with  respect-to  the  decision  vari¬ 
ables,  which  means  a  global  minimum  can  be  found  for  this 
function  if  the  decision  variables  are  confined  to  a  convex 
set.  The  chance-constrained  programming  model  which  uses 
this  objective  function  is  normally  called  the  "V  Model",  a 
terra  originated  by  the  developers  of  the  model,  Charnes  and 
Cooper.  Realistically,  one  would  not  usually  see  the  V 
Model  used  without  an  additional  constraint  that  expected 
receipts  are  greater  than  some  specified  level  that  the 
decision  maker  feels  is  satisfactory. 

Charnes  and  Ccoper  developed  another  chance -constrained 
programming  model  which  they  called  the  "P  Model".  In  this 
case  the  decision  maker  determines  some  satisfactory  level 


11 


GSA/SM/72-15 


of  receipts,  call  it  Z,  and.  then  attempts  to  maximize  the 
probability  that  receipts  arc  equal  to  or  greater  than  this 
level.  The  authors  call  the  utilization  of  this  model 
satisf icing,  a  term  developed  by  H.  A.  Simon,  Mathematically 
this  can  be  expressed  as 

max  P[^  _  ,  c.x.  *  2], 

Thi3  model  may  take  on  a  different  interpretation  if  one 
considers  Z  to  be  the  minimum  acceptable  level  of  receipts 
or,  as  some  authors  call  it,  the  "disaster  level".  In  this 
case,  the  objective  is  to  minimize  the  probability  of  ruin  or 
min  P[£^  _  i  <  Z], 

Neither  of  these  expressions  nan  be  used  as  a  deterministic 
objective  function  to  solve  the  model.  If  one  defines  the 
functions 

"o  *  =  1  an4  °o“  -  Var  *  1 

it  can  be  shown  that  it  is  mathematically  equivalent  in  both 

these  cases  to  maximize  the  following  certainty  equivalent 

objective  function 


provided  that  the  cumulative  distribution  function  of 
(IJ  =  1  °ixi  -  Wo>/°o  is  strictly  monotonic.  This  objective 
function  would  be  utilized  if  the  decision  maker’s  major 
objective  is  to  minimize  the  risk  he  faces  and  is  usually 
referred  to  as  the  safety-first  approach. 

Along  these  same  lines,  Kataoka  [22]  proposed  a  slight 
modification  to  the  above  model  which  has  also  become  known 
as  the  safeby-first  approach.  This  model  is  formulated  as 
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max  Z 

subject  to  ?[£*?  ,  c  ,x ,  <  z]  <  a. 

J  =  J  J 

This  can  be  shown  to  be  mathematically  equivalent  to  maxi¬ 
mizing 

M0  +  P_1«»)V 

where  F  is  the  cumulative  distribi  :.ion  function  of  the 
random  variable  (1^  _  ^  cjxj  ”  ^0)/°0« 

It  can  be  clearly  seen  that  the  analyst  has  a  great 
deal  of  flexibility  in  mode]';,  the  decision  maker's  atti¬ 
tude  by  using  one  of  the  above  objective  functions  and  using 
others  to  make  realistic  constraints. 

Development  of  Deterministic  Constraints 

Having  chosen  an  appropriate  objective  function,  the 
analyst  must  now  transform  the  probabilistic  constraints 
given  in  the  chance-constrained  programming  model  into  deter¬ 
ministic  or  certainty  equivalent  constraints.  Consider  the 
i-th  constraint  from  (1),  which  is  given  by 

PfSj  _  a^jXj  <  bi]  >  1  —  ct^. 

Let  x  ai.x.  -  b^  =  E(yi),  and  a*  =  Var  (yi). 

Remember  that  and  a*  are  nonstochastic  functions  of  the 
decision  variables.  Assume  that  there  is  at  least  one 
random  variable  in  each  constraint,  which  means  that  o^3  >  0, 

and  that  the  random  variable  y^  has  a  known  probability 
distribution  with  finite  mean  and  variance.  Using  these 
assumptions  the  model  can  be  transformed  into  the  following 
deterministic  equivalent  model*: 

*See  Appendix  A  for  the  mathematical  development. 
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max  fUp  . ..,  xn) 
subject  to  Mi  +  Kx  __  a  vA  <  0 


via  -  cri8  >o  1  =  1,  2,  . . . ,  m 

Vi  >  0 

Xj  >  0  J  =  1,  2,  n,  (2) 


where  n1  and  a*  are  defined  as  above  and 
h  .  a  *  V  1  (1  -  “i.): 


represents  the  cumulative  distribution  function  of  the 
random  variable  (y^  -  Mi)/oi.  When  one  utilizes  either  the 
S  Model  or  V  Model  objective  function,  (2)  yields  a  convex 
programming  problem,  and  there  are  algorithms  available  to 
solve  this  problem.  If  one  utilizes  the  P  Model  objective 
function,  the  problem  is  not  quite  as  tractible.  Remember 
that  the  oertainty  equivalent  objective  function  for  the  P 
Model  is  given  by  max  (u  -  Z)/o  where  u  *  E(E1?  ,  c.xj 

and  cr^3  =  Var  _  1  c^),  both  functions  of  the  decision 

variables.  Utilizing  this,  the  deterministic  equivalent  for 
the  P  Model  chance-constrained  programming  model  becomes : 
max  v0/wQ 

subject  to  jj.  -  Z-  v  20 

O  0 

«o8-ao^° 

*1 +  K1  -«A  vi s  0 

vi3  “  °iS  -  0  i  =  1,  2,  ra 

vi  >  0 

vo*  w0  *  0 

x,  >  0  j  =  1,  2,  ...,  n.  (3) 
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In  this  case  the  objective  function  vQ/w0  is  neither 
concave  nor  convex.  But  the  problem  can  be  solved  uqing 
fractional  programming  techniques,  and  as  a  consequence  of 
the  theory  in  this  area,  a  local  maxima  will  in  fact  be  a 
global  maxima  for  linear  fractional  functionals. 

If  the  random  variables,  a^,  ...,  a^n,  b^,  have  joint 
normal  distribution,  the  value  for  K,  can  be  found  In 

1  i 

the  cummulative  tables  of  the  standard  normal  variate,  how¬ 
ever,  if  the  random  variables  in  each  constraint  have  arbi¬ 
trary  distributions,  y^  may  still  be  approximated  by  the 
normal  distribution  since  some  version  of  the  Central  Limit 
Theorem  may  hold.  This  theorem  holds  under  weak  conditions 
for  independent  random  variables  and  under  stronger  condi¬ 
tions  for  dependent  random  variables*.  Suppose  the  distri¬ 
bution  of  is  not  known  and  the  Central  Limit  Theorem1  1 
cannot  be  applied  to  y^ .  Hillier  [18^  suggests  using  the 
one-sided  Chebyshev  inequality  which  gives  [(1  -  a. ^ ) /ct  ^  1 

as  an  upper  bound  on  K,  n  ,  and  this  value  can  be  used  in 

1  **  i  i 

the  deterministic  models  (2)  and  (3). 

Joint  Constraints 

The  concept  of  a  joint  chance-constraint  was  first 
introduced  by  Miller  and  Wagner  [24],  In  this  case  the 
model  is  formulated  as 


♦For  a  survey  of  conditions  under  which  the  Central  Limit 
Theorem  holds,  see  Hillier,  [20]. 
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max  f(x1,  xn)  •  1 

subject  to  P  ft™  a  ^  a^Xj  £  b^]  >  1  -  « 

Xi  ?  0  j  a  1|  2,  ■  •(,)  n( 

1  1  J 

In  this  formulation,  all  of  the  chance-constraints  from  (1) 
are  Joined  together  info  one  Joint  constraint.  This  formu¬ 
lation  carries  the  interpretation,  that  the  probability  that 
atiy  of  the  m  constraints  is  violated  is  less  than  a,  an 
appropriately  chosen  number  between  zero  and  one.  In  their 

I  1 

development,  Miller  and  Wagner  first  assume  that  all  the  a., 

I  * J 

1 

are  non-stochasti6  anA  that  'b^  and  bk,  i  /  k,  are  stochas- 

l  I 

tically  independent  random  variables  with  known,  continuous 
distributions.  This  implies  that  the  Joint  chance-constraint 
qan  be  represented  as 

P  ni  =  1  C2?  =  1  alJxJ  -  bi^  s  "i  =  }  =  l  aijxj  *  bi3- 

Letting  Fi(.),  represent  the  cumulative  distribution  func¬ 
tion  of  the  random  variable  b^,  they  define 

W  -  1  T  Ft(v- 

Their  model  can  then  be  expressed  as  thfe  following  nonlinear 
programming  problem: 

I  1 

max  f^,  ...»  xn) 

1  -  1  aiJAJ 


subject  to  -v,  +  S?  .  j  $  0  i  ■  1,  2,  ...»  m 


ni  =  1  Gi<vi}  *  1  “  a 

1  1 

x.  >  0  J  —  1,  2,  . . . ,  n. 

1  *» 

Notice  in  this  case  that  v^  is  unconstrained  in  sign,  and 
the  authors  remark  that  for  computational  purposes  either 

-vi  1  +  B  1  aiJxJ  =  0  or'TTi  =  1  Gi^vi^  3  1  “  a»  but  gen¬ 
erally  not  both.  If  ^  G^(v^)  is  a  concave  function, 
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then  a  global  optimum  can  be  found  by  using  some  nonlinear 
programming  algorithm.  The  major  portion  of  Miller  and 
Wagner's  paper  addresses  the  question  of  when  a  ^  Gi^vi^ 
is  concave.  They  could  not  develop  conditions  which  are 
sufficient  for  ^  (^(v^)  to  be  concave;  however,  they 

were  able  to  determine  that  it  will  not  be  concave  when  all 
the  b^  have  normal,  gamma,  and  uniform  distributions.  But 
if  one  makes  the  following  transformation 

2^  =  x  In  Gi(vi)  >  In  (1  -  a), 

the  constraint  defines  a  convex  region  when  the  distribution 
of  each  b^  is  uniform  or  normal.  This  transformation  also 
works  for  the  gamma  and  Weibull  densities,  when  their  para¬ 
meter  9  is  greater  than  one.  In  this  case  the  model  is 
formulated  as 


max  f(x^,  . ..,  xn) 

subject  to  -v  1  +  2*?  _  1  a^x^  <0  i  =  1,  2,  m 

zi  =  1  ln  W  >  in  (1  -  a) 

x^.  si  0  J  =  1 1  2,  . . , ,  n. 

The  above  arguments  can  be  directly  applied  to  the  case 
where  one  has  several  Joint  constraints  if  each  constraint 
appears  in  only  one  joint  constraint;  that  is,  there  is  no 
constraint,  2^  ^  a^x^  <  b^,  which  appears  in  more  than 

one  joint  constraint. 

Miller  and  Wagner  also  consider  the  case  where  all  the 


a^j  have  normal  distribution  and  the  b^  are  non-stochastic. 
Again  the  assumption  that  all  random  variables  are  stochas¬ 
tically  independent  is  made.  Let  y^  =  2®  =  ^  a^x^  where 
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”  E(y^)  and  o.^3  =  Var  (yA )  •  In  this  case,  the  joint 
constraint  becomes 


•  • » 


m 


Mi  +  ^  i  =  1,  2,  . 

^  ^  In  fl(v^)  >  In  (1  -  a) 

where  Q{v^)  =  1  -  Flv^);  F(.)  is  the  cumulative  distribution 
function  of  the  standard  normal  variate.  Clearly,  these 
constraints  do  not  define  a  convex  region,  so  any  algorithm 
which  solves  this  problem  may  give  only  a  local  optimum  and 
not  a  global  one. 


Safety-First  Approach  to 

Chance-Constrained  Programming 

An  approach  to  chance -const rained  programming  is  avail¬ 
able  in  the  safety-first  principle  which  is  best  described 
by  A,  D.  Roy,  [28],  when  he  said,  "...it  is  reasonable,  and 
probable  in  practice,  that  an  individual  will  seek  to  reduce 
as  far  as  is  possible  the  chance  of  sucn  a  catastrophe 
occurring."  Roy  defines  a  catastrophe  as  an  event  where  an 
individual  makes  a  net  loss  on  some  investment  or  venture. 

Such  an  approach  can  be  expressed  as  the  "P  Model"  of  the 
chance-constrained  programming  problem  which  is  formulated 
us 

rain  P[2*  =  x  S  z] 

subject  to  <  bj]  >  1  -  i  =  1,  2,  m 

XJ  *  0  J  =  1»  2»  n» 

where  Z  is  the  "disaster  level"  of  receipts. 

J.  K.  Sengupta  [29]  has  applied  the  distribution  free 
Chebyshev  inequality  to  this  problem  by  using  an  approach 
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Gomewhat  different  than  those  previously  reviewed  in  this 
chapter.  In  his  appro'  eh,  Sengupta  uses  an  idea  attributed 
to  Theil  where  there  is  a  penalty  cost  associated  with  each 
constraint.  This  penalty  cost  is  only  applied  when  the 
constraint  is  violated.  Also,  there  is  a  penalty  cost  which 
is  applied  whenever  receipts  are  less  than  or  equal  to  the 
disaster  level,  Z.  Sengupta  then  defines  a  new  objective 
function  which  can  be  called  total  expected  penalty  costs, 
thus  transforming  the  constrained  problem  into  an  uncon¬ 
strained  minimization  problem.  In  this  approach,  the  de¬ 
cision  maker  must  be  able  to  assign  a  realistic  penalty  cost 
to  each  constraint. 

To  quantify  this,  let  h  be  the  unit  penalty  cost  to  be 
applied  whenever  Z  exceeds  ^  ctjxj»  an<i  be  the  unit 

penalty  cost  to  be  applied  v*henever  ^  a^x^  exceeds  b^. 

Sengupta  assumes  that  the  are  non-stochastic  constants 
and  that  the  ci  and  b.  are  continuous  random  variables 
defined  on  a  non-negative  range.  He  defines  C(x^,  xn) 

to  be  the  expected  penalty  cost  associated  with  the  original 
objective  function  and  C^(x1,  ...,  xft)  to  be  the  expected 
penalty  cost  associated  with  the  i-th  constraint.  The  prob- 
le  can  now  be  expressed  as 

min  C(x1(  ...,  xn)  +  E“  =  x  ci(x1,  ...,  xn) 
subject  to  Xj  S  0  j  =  1,  2,  n. 

The  expected  penalty  cost  associated  with  the  i-th  constraint 
would  be  given  by 

s, 

C^U-^  ...f  x  )  =  I  1(si  -  b^  dbi, 
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where  a  ^  a.i  jx j  an,i  ic  the  Probability  density 

function  of  the  random  variable  b^.  If  b^  has  unknown  dis¬ 
tribution,  this  integral  would  be  Impossible  to  evaluate. 
However,  Sengupta  uses  the  Chebyshev  inequality  to  obtain  an 
upper  bound  for  the  integral,  and  the  bound  can  be  expressed 


Ci(x1#  ...»  xr<)  *  ki(2a  =  ±  aii)x.)o1a/nia> 

where  3  =  Var  (b^)  and  -  E(b^  -  ^  aijxj)#  Simi¬ 

larly  one  can  derive  an  upper  bound  on  the  expected  penalty 
cost  associated  with  the  objective  function, 

C(x1,  xn)  ^  h  Z  °QS/(v0  -  Z)a, 

where  oq 3  =  Var  ^  c^)  =  -  1  cjxj^* 

Following  the  safety-first  approach  to  chance-constrained 
programming,  Sengupta  would  then  solve  the  following  problem 

mtn  h  Z  °07<w0  -  3)a  +  J  k pSJ  _  x  a^x., 1°^ W 

subject  to  x.  £  0  j  =  1,  2,  n. 
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Chapter  III 

A  Distribution  Free  Approach  to 
Chance-Constrained  Programming 

In  the  last  chapter,  some  of  the  developments  in  the 
theory  of  solution  techniques  for  the  chance -constrained 
programming  model  were  reviewed.  This  included  the  intro¬ 
duction  of  the  concept  of  a  joint  chance -constraint .  Also, 
it  was  demonstrated  how  the  distribution  free  Chebyshev 
inequality  can  be  utilized  to  give  deterministic  bounds  on 
probabilities  which  can  be  used  in  the  safety-first  approach 
to  chance-constrained  programming. 

To  continue  in  thi6  fashion,  this  chapter  will  be 
concerned  with  the  utilization  of  the  one-sided  Chebyshev 
inequality  to  give  deterministic  constraints  which  can  be 
used  to  solve  the  chance-constrained  programming  model  which 
has  both  single  and  joint  chance-constraints.  Miller  and 
Wagner's  development  of  the  joint  constraint  requires  inde¬ 
pendence  of  the  random  variables  involved,  whereas  the  dis¬ 
tribution  free  techniques  developed  in  this  chapter  will 
relax  this  restriction.  The  concepts  outlined  in  this 
chapter  are  developed  from  ideas  given  to  the  author  by 
R.  A.  Agnew;  therefore,  all  credit  for  the  development 
should  be  given  to  Dr.  Agnew. 

Before  proceeding  to  the  development  of  the  distribution 
free  techniques,  one  should  consider  the  form  of  the  one- 
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sided  Chebyshev  inequality  to  be  used  in  this  development. 

It  is  taken  from  Feller  [l6].  Given  a  random  variable  x 
with  E(x)  =  0  and  Var  (x)  =  a8,  and  given  any  t  i  0,  then 
F[x  >  t]  £  aa/(o3  +  ta). 

Proceeding  to  the  development  of  a  distribution  free 
deterministic  equivalent  program  for  the  chance-constrained 
pro.Tamming  model,  let  (Jl,  Q,  P)  be  a  probability  space  and 
let  [y ^  •  ••»  i  =  1»  2,  . ra]  be  a  family 

of  random  variables  from  this  space  which  are  defined  in 
terras  of  the  non-stochastic  decision  variables.  Assume  that 
E(y^)  <  “  for  feasible  x^,  that  E (y ^ >  ;v  is  concave  and 

Var  (y^)  =  a*  is  convex  for  feasible  Xj.  One  must  remember 
that  ju^  and  are  functions  of  the  decision  variables, 

Xp  m>,  xn.  Clearly,  these  assumptions  hold  when  one  deals 
with  linear  chance -constraints.  With  this  notation  in  mind, 
the  chance-constrained  programming  model  can  be  expressed  as 
max  f(x1#  ...,  xn) 

subject  to  Pj^  a  o]  2  1  -  i  *  1,  2,  ...,  m 

Pfl  i  =  1  *  °3  2  1  -  a 

Xj  ^  0  j  s  1,  2,  •*,,  n,  (4) 

where  f  is  some  concave  function  and  a,  a1f  , ...  a  are  suit- 

able  elements  of  the  interval  (0,  1). 

In  this  particular  formulation,  there  are  m  single  chance- 
constraints  which  are  also  combined  into  one  joint  constraint. 
The  model  is  formulated  in  this  fashion  for  ease  of  devel¬ 
opment  and  presentation,  but  it  can  be  generalized  to  handle 
any  number  of  single  and  joint  constraints  by  directly 
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applying  the  concepts  that  will  be  developed. 

Using  the  one-sided  Chebyshev  inequality  and  the  sub¬ 
additivity  property  of  the  probability  measure,  one  can 
transform  the  chance-constrained  model,  (4),  into  the  fol¬ 
lowing  deterministic  equivalent  model: 
max  T(xx,  xn) 


subject  to  s  aA 


*? 


U1  >  0 
l  fci  <  a 


i  =  1,  2,  • • ■ ,  m 


x  j  -  0  J=l»2,...,n,  (5) 

where  ti  =  ai3/(°ia  +  Pi3).** 

The  problem  as  formulated  may  have  no  feasible  solution 
for  arbitrarily  stipulated  a,  a^,  . ..,  However,  one  can 

obtain  a  suitable  set  of  a's  by  first  solving 

mln  -  X  ut 

subject  to  t.  <  u,  ,  ,  0 

£  0,  Ui  >  0 

Xj  >  0  j  =  1,  2,  n,  (6) 

and  then  putting  ^  u^*  <  a,  u^*  <  a.^  where  u^*,  um*  j 

is  an  optimal  solution  of  (6).  I 

If  one  combines  (5)  and  (6)  into  one  problem  and  adds 
variables  to  make  the  model  computationally  more  tractible, 
the  deterministic  equivalent  chance-constrained  programming 
model  becomes 


max  f(xlf  ...,  xn) 


••Mathematical  development  is  contained  in  Appendix  A. 
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* 


a  1 f  2,  *•••  n.  (7 ) 

Unfortunately,  the  above  constraints  do  not  define  a 
convex  region,  so  the  problem  is  not  a  convex  programming 
problem.  This  means  that  any  nonlinear  programming  algorithm 
used  to  solve  this  problem  may  converge  to  only  a  local  max¬ 
imum  and  not  to  a  global  one.  But  fortunately,  the  constraints 
and  the  objective  function  are  differentiable,  which  means 
that  there  is  a  nonlinear  programming  algorithm  which  can  be 
used  to  find  a  local  maximum  [l?].  -Furthermore,  it  will  be 
assumed  that  the  decision  maker,  who  is  trying  to  optimally 
achieve  his  objective  in  an  environment  of  uncertainty  and 
risk,  will  be  satisfied  with  a  locally  optimal  choice  for  the 
decision  variables  x^;  at  least,  until  a  better  choice  can 
be  found. 

As  mentioned  previously,  this  model  can  be  generalized 
to  handle  any  number  of  single  and  joint  constraints.  Suppose 
one  has  the  chance-constrained  programming  model  with  only 
single  chanc j-constraints .  The  analyst  would  utilize  the 
deterministic  model,  (7),  except  he  would  delete  the  constraint 


subject  to  >  WjV^ 

V  -  °ia 

ui^wia  +  S  1 

U1  s  ai 

ui»  vl*  wi  s0 

Xj>0  J 


Z 


u. 


<  1  -  a. 
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If  the  model  were  given  with  only  the  joint  chance-constraint , 
the  analyst  would  delete  the  constraints 

<  aA  for  i  =  1,  2,  ra. 

Specifically,  (7)  can  be  applied  to  the  linear  chance- 
constrained  programming  model  with  both  single  and  joint 
constraints.  In  this  case,  the  model  would  be  formulated  as 
max  f(xlt  xn) 

subject  to  P[£^  *  i  aijxj  *  -  1  ~  ai  i  =  1,  2,  ...,  m 

Pfli  *  1  -  1  aijxj  5  bi^  -  1  "  a 

xj  -  0  j  =  1»  2'  •••»  n* 

Then,  the  ylf  and  Oj8  would  be  given  by 

yl  ■  bi  ■  EJ  -  1  aiJxJ> 

H  -  E(bi>  -  -  i  E(au)icr  and- 

°ia  ”  EJ  -  1  Ek  1  1  °®v  (alj>  alk)xJxk 

*2E "  =.  1  oov  (3iJ  ,  b^JXj  +  var  (b.^) . 

If  one  has  estimates  of  the  means,  variances  and  covariances 
of  the  random  variables  involved,  they  can  be  put  into  these 
equations  and  substituted  into  (?).  Moreover,  if  estimates 
of  the  covariances  are  not  known,  one  can  use  the  following 
bound 

oi  <  3  1  (var  (a^))^  •»  (var  (b^)^, 

in  the  constraint  Vj8  £  °ia(x)  to  get  the  following  constraint 

▼1  <r  =  1  (var  (a^))^  +  (var  (b^)^. 

Although  in  some  cases  the  Chebyshev  inequality  may 
give  a  rough  bound  on  a  probability  measure,  it  has  a 
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desirable  property  that  it  holds  regardless  which  probability 
distribution  the  random  variables  involved  may  have.  The 
inequality  is  particularly  useful  when  adapted  to  sums  of 
random  variables  which  is  the  case  with  the  linear  chance- 
constrained  programming  model.  Furthermore,  it  has  been 
demonstrated  that  the  inequality  can  be  used  to  develop  a 
deterministic  equivalent  model  which  can  solve  the  most  gen¬ 
eral  case  of  the  chance-constrained  programming  model  which 
has  both  single  and  joint  chance-conBtraints. 
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Chapter  IV 

Chance-Constrained.  Input-Output  Analysis 
Now  that  a  distribution  free*  deterministic  equivalent 
model  for  the  chance-constrained  programming  model  has  been 
developed,  attention  will  now  be  turned  to  the  area  where 
this  model  will  be  applied — Leontief 's  input-output  analysis. 
Input-output  analysis  is  well  suited  to  the  chance-constrained 
programming  approach  since  input-output  analysis,  in  its 
simplest  form,  is  a  linear  programming  problem  where  the 
constants  and  coefficients  of  the  model  are  random  variables, 
usually  with  unknown  distributions.  Therefore,  the  chance- 
constrained  programming  approach  will  give  the  decision 
maker  everything  the  normal  approach” to  input-output  analysis 
gives,  plus  further  insight  into  the  risk  and  uncertainty 
that  the  decision  maker  faces.  Furthermore,  it  will  enable 
him  to  directly  control  some  of  this  risk.  Before  proceeding 
with  the  development  of  a  chance-constrained,  input-output 
model,  a  few  words  will  be  said  about  the  theory  of  input - 
output  analysis. 

Input -Out put  Analysis 

Consider  an  economy  which  has  n  sectors  where  each 
sector  is  producing  one,  and  only  one,  distinct  product. 

Output  from  any  particular  seotor  may  be  needed  as  an  input 
for  itself  and  for  other  sectors.  Furthermore,  the  open 
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model  will  be  considered,  which  allows  outside  demand  to 
occur;  this  could  be  interpreted  to  include  consumer  demand, 
demand  generated  by  the  government ,  and  demand  for  export , 
Also,  assume  that  there  is  a  finite  labor  supply  and  that 
each  sector  demands  labor  in  order  to  produce  goods.  In 
order  to  have  a  viable  economy,  total  production  of  product 
i  must  be  greater  than  or  equal  to  the  total  demand  for 
product  i,  which  includes  outside  demand  and  the  demand  from 
each  sector.  Furthermore,  total  demand  for  labor  must  not 
exceed  the  total  labor  supply. 

To  quantify  this,  let  x.  be  the  total  number  of  units 

•L 

produced  of  product  i.  Let  be  the  number  of  units  of 
product  i  needed  to  produce  one  unit  of  product  J.  Also, 
let  aQj  be  the  number  of  units  of  labor  needed  to  produce 
one  unit  of  product  J ;  L  represents  -the  total  amount  of  labor 
available  in  the  labor  market.  Finally,  let  represent 
the  outside  demand  for  product  i.  The  production  and  labor 
constraints  can  now  be  represented  as 

xi  “  =  1  ai,)xj  *  Di  1  =  1»  2»  n 

=  1  aojxj  -  L ' 

Letting  be  the  production  cost  of  product  i,  the 
input-output  analysis  model  can  be  represented  by  the  fol¬ 
lowing  linear  program 

mm  =  x  cj3tj 

subject  to  xi  "  -  i  aijxj  -  Di  i  **  1>  2,  ...,  n 
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This  model,  aa  formulated,  can  be  interpreted  to  mean  that 
economic  planners  are  attempting  to  minimize  production 
costs,  subject  to  the  constraints  that  production  in  each 
sector  exceeds  total  demand  and  that  total  demand  for  labor 
does  not  exceed  the  total  labor  available. 

i  1 

Leontief's  model  is  important  since  it  recognizes  that 
a  very  considerable  portion  of  the  effort  qf  a  modern  economy 
is  devoted  to  the  production  of  intermediate  goods,  dnd  the 
output  of  intermediate  goods  is  closely  linked  to  the  output 
of  final  products;  Therefore.,  a  change  in  the  level  of 
output  of  some  final  product  can  cause  widespread,  changes  1 
throughout  the  economy  in  the  level  of  production  of .inter¬ 
mediate  goods.  In  other  words,  input-output  analysis 
describes  a  national  economy  as  a  system  of  mutually  inter¬ 
related  sectors  or  interdependent  economic  activities. 

This  interrelation  actually  consists  of  flows  of  goods  and 
services  which  directly  or  indirectly  link  all  the  sectors  t 
of  the  economy  together.  Leontievs  approach  is  particularly 
important  since  it  highlights  this  interdependence  of  the 
economic  sectors.  Another  important  feature  of  Leontief's 
model  is  that  it  is  strongly  dependent  on  empirical  investi¬ 
gation. 

The  model  has  been  successfully  applied  to  the  United 
States  economy,  and  large  tables  have  been  constructed1  which 
show  how  goods  and  services  flow  throughout  the  U.  S.  econ¬ 
omy.  The  model  can  be  of  great  use  for  economic  planning  in 
developing  nations  since  it  can  be  utilized  to  predict  the 
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i 

"Useful"  production  capability  of  that  nation.  In  the  same 

I 

light,  it  can  be  used  for'  planning  optimal  levels  of  econ- 

i  . 

i  *  1 

omic  r  r*owth.  Furthermore,  the  model  can  bo  an  aid  for 
economic  planning  in  military  mobilization  problems. 

Although  Lepntief  developed  the  model  for  a  large 
economic  system,  it  can  be  readily  seen  that  input-output 

analysis  can  be  applied  to  problems  much  smaller  in  scope. 

1  ,  1  ■ 

The  model  can  be  applied  to  any  organization  or  system  that 
is  composed  of1  components  which  supply  goqds  and  services  to 

I 

other1  components  within  the  organization  or  system.  Fur- 

i 

thermorer  these  goods  and  services  may  be  supplied  to 
dctivlties  outside  the  organization,  Clearly,  this  would 
include  large  manufacturing  organizations . and  a  military 
activity1  like  the  U.  S.  Air  Force. 

i  > 

Baumol  [5]  points  out  two  simplifying  assumptions  made 
in  input-output  analysis  which  have  come  under  criticism. 

One  is  the  assumption  that  each  sector  manufactures  only  one 

1 

homogeneous  product  or  good.  This  restriction  may  be  relaxed 
somewhat  by  interpreting  this  product  as  a  composite  commod¬ 
ity.  The  second  and  more  restrictive  assumption  made  is 

t  I 

that  all  inputs  needed  in  the  manufacturing  of  a  unit  of 
output  are  utilized  ini  fixed  proportions.  This  does  not 
allow  the  possibility  of  trade-offs  or  substitution  of 
inputs.  Clearly,  adoption  of  the  chance-constrained  approach 
will  relax  this  second,  assumption. 

Another  drawback  against  uping  input-output  analysis  is  j 

that  a  great  amount  of  statistical  effort  must  be  expended  j 

.1  1  j 
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in  order  to  come  up  with  timely  forecasts  of  demand  and 
estimators  of  the  technical  coefficients,  a^j.  It  might  be 
pointed  out  that  this  statistical  effort  could  also  provide 
an  estimation  of  the  variance  of  these  estimators  without 
much  greater  effort  being  expended. 

The  Model 

The  chance-constrained,  input-output  analysis  model 
will  now  be  developed,  and  it  deviates  from  the  usual  eco¬ 
nomic  interpretation  since  two  military  units  will  be 
considered  as  the  economic  sectors.  These  will  be  an  air¬ 
lift  command  which  will  represent  sector  I  and  a  logistics 
command  representing  sector  II.  Now  sector  I,  the  airlift 
command,  provides  a  service  whose  unit  of  measure  is  a  ton 
of  materiel/personnel  transported.  Sector  I  provides  this 
service  to  itself,  to  sector  II,  and  to  other  military 
activities.  Likewise,  sector  II  provides  a  product  whose 
unit  of  measure  is  a  ton  of  materiel  supplied.  Again  it 
uses  the  product  itself,  and  the  product  is  used  by  sector  I 
and  by  other  military  activities. 

To  quantify  this  problem,  let  x.^  represent  the  total 
amount  of  airlift  support  provided  by  sector  I.  Let  be 
the  random  variable  which  represents  the  amount  of  airlift 
support  required  to  supply  one  ton  of  materiel/personnel 
transported,  and  a12  represents  the  random  amount  of  airlift 
support  needed  to  provide  one  ton  of  materiel  supplied.  Let 
represent  the  demand  for  airlift  support  by  all  other 
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military  activities.  Similarly,  let  a,^,  a22,  °2  136  ^be 

random  demands  for  logistic  support,  and  let  x2  be  the  total 
amount  of  logistic  support  provided  by  sector  II.  To 
restrict  the  model,  assume  that  x^  and  x2  are  non-stochastic 
decision  variables.  This  is  not  too  an  unrealistic  assump¬ 
tion  if  one  interprets  and  x2  to  be  the  upper  bound  on 
the  airlift  and  logistic  support  that  decision  makers  are 
willing  to  provide.  Furthermore,  let  c1  and  c2  be  the  random 
unit  cost  in  thousands  of  dollars  of  airlift  support  and 
logistic  support.  Let  100  be  the  number  of  manhours  required 
to  provide  one  ton  «f  materiel/personnel  transported,  50  be 
the  number  of  manhours  required  to  provide  one  ton  of  mater¬ 
iel  supplied,  and  650,000  the  total  number  of  manhours 
available  to  both  the  airlift  command  and  the  logistics 
command.  Finally,  assume  that  decision  makers  require  that 
the  demand  for  airlift  support  will  be  met  with  at  least 
probability  .95;  also,  they  require  that  the  demand  for 
logistic  support  will  be  met  with  at  least  probability  .9. 
Lastly,  decision  makers  require  that  the  total  demand  for 
both  airlift  support  and  logistic  support  will  be  met  with 
at  least  probability  .9. 

The  chance-constrained,  input-output  analysis  model  is 
now  given  by 

min  E^x.^  +  °2x2) 

subject  to  P[<1  -  -  a12x2  2:  Dj]  >  .95 

Pf-“a21xl  +  ^  “  a22^X2  *  °2^  -  *9 
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p 

(1  -  a12)  -  aI2 

X1 

> 

Dl] 

"a21  1  "  a22 
U  J 

X2 

°2 

L 

>  .9 


xl*  x2  -  °» 

where  the  objective  is  taken  to  be  the  minimization  of 
expected  costs. 

Suppose  statistical  analysis  gives  the  following  values 
for  estimators  of  the  mean  and  variance  of  the  above  random 
variables. 


Random  Variable 

Mean. 

Variance 

C1 

35 

5 

c2 

25 

3 

all 

.25 

.0025 

a12 

.3 

.0009 

a21 

.15  . 

.0001 

a22 

.2 

.0004 

°1 

1000 

10,000 

D2 

1500 

12,000, 

covariances  are  given 

by 

^11*  a12 

=  -.0009 

°a21»  a22 

=  -.0001 

* 

All  other  covariances  are  zero. 

Following  the  non-stochastic  approach  to  input-output 
analysis,  Department  of  Defense  planners  would  take  the  esti¬ 
mators  of  the  means  of  the  random  variables,  and  solve  the 
following  linear  programming  model. 
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min  35x^  +  25xg 
subject  to  •75x1  -  *3x2  >  1000 

-  • l^x-,  +  ,8x„  >  1500 

x^  +  .5^2  <  6500 

xl*  x2  -  0 

Solving  this  problem,  one  obtains  the  solution  x-^  »  2252*252 
and  *■  2297*297,  which  gives  total  expected  cost  of 
$136,261,300.  Not  much  can  be  said  about  this  policy  since 
there  is  no  measure  of  the  risk  associated  with  its  adoption. 
Application  of  the  Chebyshev  inequality  gives  zero  as  the 
lower  bound  of  the  probability  that  the  total  demand  for 
airlift  support  will  be  met.  Likewise,  zero  is  the  lower 
bound  of  the  probability  that  the  demand  for  logistic  support 
will  be  met.  Such  a  policy  3hould  not  have  much  appeal  to 
decision  makers  since  they  are  faced., with  an  undetermined 
amount  of  risk. 

Using  the  estimates,  the  deterministic  equivalent  for 
the  chance-constrained,  input -output  model  is  given  by 

min  35x1  +  25x2 

subject  to  .75x1  -  .3*2  -  1000  -  w-^Vj  >  0 
-.15:«1  +  *8x2  -  1500  -  w2v2  0 
vx3  -  .oo25xi3  -  ,ooo9x23  +  .0009x3*2  -  .10000  >  0 

•  v2a  -  .OOOIX38  -  ,0004x2s  +  .0001x^2  -  12000  >  0 

ul(Wia  +1)  -  1  >  0 

u2(w2a  +1)  -  1  >  0 
.05  -  >  0 

.1  -  u2  >  0 
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.1  ~  -  U2  >  0 

6500  -  -  ,5x2  >  0 

Xl>  X2*  ul»  u2*  vls  V2 »  wi»  w2  -  0 
Using  Fiacco  and  McCormick's  nonlinear  programming  algorithm 

[17]  to  solve  this  problem*,  one  gets  x1  =  3909.8  and 
x2  *=  3310.4  as  the  solution  which  gives  $219,603,000  as  the 
expected  cost.  What  else  can  be  said  about  establishing 
this  level  for  the  decision  variables?  One  can  say  that  the 
probability  that  the  total  demand  for  airlift  support  will 
be  met  is  at  least  .95*  and  the  probability  that  the  total 
demand  for  logistic  support  will  be  met  is  at  least  .9  (in 
fact,  it  is  at  least  .95) »  end  the  probability  that  total 
demand  is  met  is  at  least  «9»  Clearly,  much  of  the  uncer¬ 
tainty  associated  with  the  previous  policy  has  been  eliminated. 

Since  some  of  the  advantages  of.  using  the  chance- 
constrained  model  have  been  stated,  the  major  disadvantage 
must  also  be  pointed  out.  One  desirable  feature  of  the 
Chebyshev  inequality  is  that  it  holds  regardless  of  the 
distribution  of  the  random  variables  being  measured.  But 
this  feature  can  clearly  work  against  anyone  using  it  in  the 
above  model,  since  it  can  induce  a  decision  maker  to  select 
a  more  cautious  policy  than  one  he  might  normally  select. 

This  action  would  most  certainly  increase  his  costs.  To  see 
this,  one  should  remember  that  the  Chebyshev  inequality  is 
used  to  obtain  a  lower  bound  on  the  probability  that  some 


♦See  Appendix  B. 
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particular  constraint  be  met.  If  this  lower  bound  is  set 
equal  to  some  appropriate  number,  say  .95  for  example,  it 
is  quite  possible  that  the  true  measure  of  the  probability 
is  higher  than  this  bound.  In  fact,  the  true  probability 
could  be  extremely  close  to  one;  it  is  in  the  example,  if 
one  assumes  that  each  constraint  has  an  underlying  normal 
distribution. 

This  undesirable  feature  must  be  considered  the  price 
one  must  pay  for  not  knowing  the  distributions  of  the  random 
variables  associated  with  the  model.  As  with  any  model,  it 
does  not  answer  all  questions  that  a  decision  maker  might 
have  concerning  the  uncertainty  he  faces;  however,  it  cer¬ 
tainly  gives  him  insight  into  his  problems.  Also,  the  model 
rnay  be  reformulated  to  be  of  greater  use  to  the  decision 
maker.  Such  a  formulation  could  be 
min  +  u2 

subject  to  P[(l  -  a-Ll^l  -  ai2x2  -  D]3  ^  1  -  ui 

T5p  v  -1.  t  “  _  o  \  v  H  1  !>  1  _  1 1 

l2 

|~ r ( 1  **  an  )  “aiol  M  foil 
P 


“a2!  (1  "  a22'J 


X. 

X1 

> 

CM 

X 

l°2_ 

>  i  -  U1  -  u2 


pC°lxl  +  c2x2  S  oB]  >  1  -  9 
X1  +  *^x2  -  ^500 
xlt  x2,  \ilt  \i2  >  0, 

where  the  random  variables  are  as  previously  defined,  and 
is  the  budgeted  cost  ceiling  placed  on  the  model.  This  model 
has  the  interpretation  that  one  is  attempting  to  minimize  the 
risk  of  not  meeting  total  demand,  subject  to  the  constraint 
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that  the  probability  that  total  costs  do  not  exceed  the 
budgeted  ceiling,  is  greater  than  1  -  p.  Clearly,  thi3 
model  would  be  of  great  value  to  the  decision  maker  since  he 
is  getting  the  greatest  amount  of  risk  aversion  for  each 
dollar  he  spends,  plus  he  is  given  an  upper  bound  on  the 
measure  of  the  risk  that  he  must  face  by  adopting  this  pol¬ 
icy. 

It  has  been  demonstrated  that  the  chance-constrained 
programming  model  can  be  applied  to  the  input-output  analysis 
model.  Clearly,  a  chance-constrained,  input-output  analysis 
model  could  be  developed  for  the  U.  S.  Air  Force  and  could 
be  used  for  budgeting  and  force  structure  problems.  However, 
a  competent  analyst  might  ask  whether  the  application  of 
chance-constrained  programming  to  input-output  analysis  is 
contrived.  Or  he  might  ask  whether  -the  insights  gained  by 
using  the  model  are  worth  the  computational  burdens  that  the 
model  places  on  him.  To  answer  these  questions,  he  must 
consider  the  advantages  of  using  the  model.  One  major 
advantage  is  that  is  forces  the  decision  maker  to  recognize 
the  risk  and  uncertainty  that  he  faces,  and  it  gives  him  a 
direct  control  over  some  of  this  risk.  Furthermore,  the 
model  is  "distribution  free"  since  the  analyst  need  not  know 
the  probability  distribution  of  the  random  variables  involved; 
he  only  need  know  estimations  of  the  mean  and  variance  of 
each  random  variable.  The  model  can  readily  be  used  for 
budgeting  or  personnel  allocation  problems.  Finally,  the 
model  is  particularly  applicable  for  optimal  economic 
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planning  in  organizations  which  are  comprised  of  interrelated 
groups,  where  these  groups  supply  goods  and  services  to  each 
other  and  to  activities  outside  the  organization.  In  this 
light,  chance-constrained,  input-output  analysis  can  be 
considered  as  matheraetical  programming  from  the  systems 
management  point  of  view. 
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Appendix  A 

Mathematical  Development  of 
Deterministic  Constraints 

Suppose  one  is  given  the  chance-constraint 

PEyi  =  =  1  aijxj  “  ^  *  1  - 

where  has  a  known  probability  distribution  with  mean 

=  ^(x-p  , xn)  and  variance  a^9  =  a^U^,  xn) . 

The  problem  is  to  develop  a  deterministic  equivalent  con¬ 
straint  for  the  above  probabilistic  constraint. 

=  l  aijxj  5  b4]  =  p[yi  s  0] 

=  pC^  -  wi)/°i  *  s  i  ■  »!« 

This  probabilistic  constraint  holds  if  and  only  if 

-V°i  *  P‘1(1  -  ai>  -  K1 

where  P(.)  is  the  cumulative  distribution  function  of  the 
random  variable  (y ^  -  n ^ )/o^.  This  deterministic  constraint 
can  be  rendered  more  tract ible  by  adding  a  variable  to  give 

+  K1  -  vi  5  0 

v,8  .«^0 
vi  >  0. 

Use  of  the  Chebyshev  Inequality  to 
Give  Deterministic  Equivalent 
Constraints  for  Both  Single  and 
Joint  Chance-Constraints 

Suppose  one  is  given  the  single  and  joint  chance- 
constraints 
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PCy^  £  ol  —  ^  “  oc  i  ■  1,  2 ,  • . . ,  m 

P  ni  =  1  (yi  -  0)  -  1  “  a» 
where  Ety^  =  and.  Var  (y^)  «  o^3.  Consider 

P[y1  >  o]  =  l  -  p[y1  <  o]  =  l  -  pC^  -  yx  >  jatL 

But  the  one-sided  Chebyshev  inequality  gives. the  following 
bound  1 

I 

“  yi  >  J1i^  -  0i3/^0i3  +  wi3^*  Provided  ^  >  0. 

This  implies  that 

P [yL  >  o]  >  l  -  °i3/(oi3  +  MAa ) . 

The  constraint  p[y^  >  03  >  1  -  holds  if  and'  only  if 
o * / (a  3  +  ja^3 )  s  a^.  Now  consider  the  joint  constraint 

p  ni  =  1  (yi  S0)=l-PUj  =  1  (yi<0) 

”  i  -  p  u“  ,  !  [Ul  -  jTi  >  Mj]  a  1  -  ^  .  t  pC^  -  >  » 

I 

which  follows  from  the  subadditivity  prpperty  :Of  any  proba¬ 
bility  measure.  Again  using  the  Chebyshev  inequality  one  has 

P  ni  =  1  {yi  -  0)  *  1  "  Li  =  1  °i3/(°i3  +  )  *  *  -  a  • 

The  constraint  holds  if  and  only  if 

,5-  i°i^(0is  +V) *“• 

Utilizing  these  inequalities,  the  deterministic  equivalent 

I 

constraints  can  be  written  as  ( 

t,  <  a 

i  =  1,  2,  ...»  m. 

^  i° 

^  „  i  tt  5  a, 
where  -0^/(0^  +  u*). 
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I 

Appendix  B 

Nonlinear  Programming 

I 

This  section  outlines  the  nonlinear  programming 
algorithm  used  by  the  author  to  solve  the  deterministic 
equivalent,  chance -constrained,  input-output  analysis  model 
in  chapter  IV.  It  is  Fiacco  and  MfcCormick's  interior  point, 
unconstrained  Algorithm 4,  To  understand  its  use,  consider  a 

I 

nonlinear  programming  model  which  can  be  formulated  as 
'  Mla  hixl<'  ••••  xn>* 

subject  tio  gi(x1,  .  .i,  xn)  £  0  i  =  1,  2,  m. 

In  their  interior  point  algorithm,  Fiacco  and  McCormick 
transform  the  constrained  problem  into  an  unconstrained  mini- 

J 

raization  problem  by  using  some  transformation  of  the  form 
w(fl>  ••••  xn-  r)  *  h(xl'  •••'  xn> 

I  "**  ^  ja  ^  •••»  *n)  )  » 

where  s(r’j|  is  some  function  of  r  which  has  the  property 
s(r)  -*  0  as  r  -*  0,  and  xn) )  is  some  function 

of  the  ,i-th  constraint  which  has  the  property  I(gi(x-L,  ...,  xn)) 
■•"as  gi(x1,  xn)  -*  0,  In  solving  the  problem  in  chapter 

IV,  the  functions,  s  and  I,  were  taken  as 

s(r)  =  r,  and  I(gi(x1,  ...,  xn))  =  -In  Si(x1,  xn). 

I  . 

*If  one's'  objective  is  max  f(xlf  ...,  xn),  one  must  define 
h('x^,  xn)  =>  -  t(x^,  . ..,  xn)  in  order  to  use  Fiacco 

and  McCormick's  algorithm. 
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Thi:s  gives  the  problem 

,llin  W(xl*  V  r)  =  h(xl»  *•*»  xnJ 

~  ^  -  2. 

Basically,  the  method  of  solution  is  to  solve  this  problem 
for  arbitrary  positive  r,  decrease  r  (but  keeping  it  positive) 
and  solve  the  problem  again.  Continuing  in  this  fashion, 
one  will  generate  a  sequence  of  values 

for  i  =  1»  2,  n.  If  r^^  "*  0  as  k  -*  »,  then 

(k) 

xi  "*  xi*  as  k  -*  oo,  i  =  1,  2,  , n,  where  x.*  is  the 
i-th  element  of  the  vector  x*  which  is  a  point  that  will  give 
a  local  minimum  to  the  constrained  problem. 

Fiacco  and  McCormick  prove  that  if  the  functions 
*\  &it  •••»  gm  are  continuous  and  if  one  follows  the  above 
procedure  in  minimizing  W(xx,  ...,  xn,  r),  the  sequence  of 
solutions  will  converge  to  a  locally  optimal  vector,  x*,  for 
the  constrained  problem 

min  h  (x^ ,  «•«,  x^ ) 

subject  to  gi(x1,  xn)  >  0  i  =  1,  2,  m 

provided  a  local  minimum  exists.  If  h(Xp  x  )  is  also 

a  convex  function  and  gi(x1,  xft)  is  a  concave  function, 

1  =  1,  2,  m,  the  convergence  is  global.  Unfortunately, 

this  is  not  the  case  for  the  problem  in  chapter  IV. 

The  Algorithm 

Expressing  the  constrained  problem  as  the  following 
unconstrained  function 


45 


GSA/5M/72-15 


W(x1,  ....  xn,  r)  =  h(xlf  . ..,  xn) 

“  r  =  i  ln  Si(^1»  »  xn) 

the  solution  to  the  constrained  problem  is  obtained  by  using 

the  algorithm  outlined  below. 

Step  1.  An  initial  vector  x^  =  (x^0^,  . ..,  x^0))  .13 

chosen  such  that  g^x^)  >  0  for  i  =  1,  2,  , m. 

Step  2,  An  initial  value  for  r^  is  chosen,  in  this  case 
^  s  1  is  used. 

Step  3»  Using  ^  and  rk,  the  function  W(x1,  xn,  rk) 

is  minimized  over  n  space  giving  x'  ,  The  steepest 
descent  algorithm  is  utilized  for  this  purpose, 
although  the  Newton  method  could  also  be  used. 

However,  with  the  Newton  method,  one  must  compute 
the  Hessian  matrix  of  W(x^,  ...,  xn,  r),  and  this 
becomes  impractical  as  the  number  of  variables  and 
the  number  of  constraints  increases. 

Step  4.  Terminate  computations  if  the  new  solution  is 
acceptable;  if  not,  continue. 

Step  5*  Select  a  new  value  for  rk  +  ^  +  i  =  rk^2  is 

used  in  the  problem. 

Step  6,  Using  the  new  values  for  (x7 ,  x^)  and  r,  return 

to  step  3« 


Minimizing  a  Function  Using  the 
Steepest  Descent  Method 

The  steepest  descent  algorithm  which  can  be  used  to 
minimize  an  unconstrained  function  is  an  iterative  technique 


which  utilizes  only  the  first  partial  derivatives.  Suppose 
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one  desires  to  minimize  the  function  W(x,  r^)  with  respect 

to  the  vector  x  while  holding  r,c  fixed.  Using  the  steepest 

(o) 

descent  method,  one  selects  an  arbitrary  vector  x'  '  and. 
computes  V  W(x^  ,  r^),  tJae  gradient  vector  of  W  with  respect 
to  the  vector  x;  then  a  new  value  for  the  vector  x  is  found 
by  using  the  iterative  relation 

x*1  +  ^  =  x^  -  X^WU^,  rk), 
where  X^  is  the  smallest  non-negative  value  which  locally 
minimizes  W  along  -Vw(x^,  r^)  starting  from  x^.  X^  is 
usually  found  by  finding  an  upper  and  lower  bound  on  it  and 
then  shrinking  the  interval  of  these  bounds  until  they 
converge  to  the  desired  point. 

The  algorithm  is  terminated  when  the  norm  of  the  gra¬ 
dient  vector  is  suitably  small. 
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